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Background 

The Paperwork Reduction Act of 1995, 44 U.S.C. Ch. 35 (the “PRA”), enacted specific 
provisions pertaining to the subject of these proposed guidelines. One of those provisions, Section 
3504, directed OMB “to develop and oversee the implementation of policies, principles, standards, 
and guidelines” for Federal agency dissemination of public information; while another, Section 
3516, directed OMB to “promulgate rules, regulations, or procedures necessary to exercise the 
authority provided by this chapter.” However, the statute did not contain a timeframe within which 
the OMB guidance was to be promulgated. Nor did it provide specifically for public and agency 
input into development of the guidance. 

Subsequently, OMB issued Circular A-130, which contained some limited guidance 
regarding the information dissemination provisions in the PRA. Much of the Circular was devoted 
to processing of agency information collection requests and technical aspects of agency information 
management policy. Congress considered the guidance in Circular A-130 on information 
dissemination to be inadequate and urged OMB to promulgate separate guidance to address 
specifically those PRA provisions, along with provisions to ensure a degree of accountability. The 
House report on the FY appropriation bill for OMB (No. 105-592) stated, at pp. 49-50: 

The committee urges the Office of Management and Budget (OMB) to develop, with 
public and Federal agency involvement, rules providing policy and procedural 
guidance to Federal agencies for ensuring and maximizing the quality, objectivity, 
utility, and integrity of information (including statistical information) disseminated 
by Federal agencies, and information disseminated by non-Federal entities with 
financial support from the Federal government, in fulfillment of the purposes and 
provisions of the Paperwork Reduction Act of 1995 (P.L. 104-13). The Committee 
expects issuance of these rules by September 30, 1999. The OMB rules shall also 

- 1 - 


PM3001117878 


Source: https://www.industrydocuments.ucsf.edu/docs/yxxk0001 



Center for Regulatoiy Effectiveness 


cover the sharing of, and access to, the aforementioned data and information, by 
members of the public. Such OMB rules shall require Federal agencies to develop, 
within one year and with public participation, their own rules consistent with the 
OMB rules. The OMB and agency rules shall contain administrative mechanisms 
allowing affected persons to petition for correction of information which does not 
comply with such rules; and the OMB rules shall contain provisions requiring the 
agencies to report to OMB periodically regarding the number and nature of petitions 
or complaints regarding Federal, or Federally-supported, information dissemination, 
and how such petitions and complaints were handled. OMB shall report to the 
Committee on the status of implementation of these directives no later than 
September 30, 1999. 

Nevertheless, OMB did not take action to promulgate such rules; nor did it report to the 
Committee. Consequently, in the next Congress provisions were introduced into the OMB 
appropriations bill to require promulgation of the rules by a date certain. In response, OMB pointed 
out that its Circular A-130 already contained certain provisions pertaining to the subj ect, particularly 
the provision requiring agency CIOs to act as “ombudsmen” in investigating and acting on 
allegations of agency failure to follow the OMB guidance. At the same time, however, OMB 
acknowledged that it was “sensitive to the possibility that OMB Circular A-130 might need to be 
updated or supplemented to deal with concerns in this area.” 2 

Subsequently, Congress supplemented the PRA provisions with the provisions contained in 
section 515 of the OMB appropriations bill for fiscal year 2001, P.L. 106-554. Those provisions 
set a timeframe for promulgation of OMB guidance and conforming guidance by all Federal 
agencies, and they reference the underlying requirements of the PRA for issuance of OMB and 
agency-specific conforming rules.. The provisions contain much the same directives as were set out 
in the House report quoted above. The OMB guidance which is the subject of these comments is 
proposed for issuance pursuant to those two related legislative directives (i.e., the PRA and the 
FY2001 appropriations Act). 

1. Incomplete Citation of Legal Authority 

The proposal references only the Appropriations Act provisions as the statutory authority for 
the guidance. The appropriations language itself is explicitly based on, and supplements, the PRA. 
The PRA contains the original directive to OMB to issue guidance for the agencies, and the 
requirement that the agencies issue conforming rules. The PRA also contains additional detail that 
is not in the appropriations legislation, such as the requirement for pre-release consultation with 
stakeholders for significant new information dissemination products, or modifications or 
terminations, and provisions concerning the authority and duties of the agencies’ Chief Information 
Officers. The OMB guidance should describe the PRA as containing the original and fundamental 
statutory authority and directives, and the Appropriations Act as supplemental to the PRA. 


2 Letter dated April IS, 2000, from John T. Spotila, Administrator of OMB’s Office of 
Information and Regulatory Affairs, to Representative Jo Ann Emerson. The text of this letter is 
available on the CRE website, www.thecre.com, under “Data Quality”. 
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1. Need for Clarification of Relationship to Circular A-130 

The Circular and its explanatory Appendix IV currently contain a limited number of 
provisions implementing the information dissemination provisions of the PRA. Those provisions 
should be retained. The proposed OMB rules are not clear on whether the new guidance replaces 
the Circular or supplements it, and they do not inform the public and would-be commenters 
concerning the specific applicable provisions in the Circular. It would improve the clarity and user- 
friendliness of the OMB guidance considerably if the scattered relevant provisions from the Circular 
and the explanations from the Appendix were consolidated with the new rules. 

There are a number of places in the proposed guidance where the term “should” is used in 
place of “shall” or “must”. For example, section III, 1 states that “agencies should adopt a high 
standard of quality (including objectivity, utility, and integrity) as a performance goal.” (Emphasis 
added.) The use of the term “goal” further dilutes the directives. This is inconsistent with directives 
in Circular A-130 and the underlying statutory authority which use the terms “shall” and “must”. 
The Congressional intent is clear that the OMB and agency guidance documents are not 
discretionary, advisory, or heuristic; they are intended to be mandatory. 


3. Limitations on Agency Authority to Disseminate Specific Information Products 

An agency’s authority to develop and disseminate information products is not without limits. 
Agency authority to spend appropriated funds is limited to purposes specifically authorized by 
statute. Development and dissemination of electronic information, including web pages and linked 
documents requires the expenditure of public funds. It is not sufficient for an agency to justify 
creation and dissemination of information on grounds that they are simply “consistent with the 
agency’s mission”. 44 U.S.C. § 1108 states that agencies may use appropriated funds only for the 
printing of such publications as are “necessary in the transaction of the public business required by 
law...” These limitations are contained in the statutory authority for public printing and documents, 
which has been interpreted to apply to all types of public information, regardless of form or format, 
by OMB in Circular A-130. Circular A-130 states that agencies must “[ajssure that information 
dissemination products are necessary for proper performance of agency functions (44 U.S.C. 
1108)...” Sec. 8, 6(a). The Circular defines “information dissemination product” as “any book, 
paper, map, machine-readable material, audiovisual production, or other documentary material, 
regardless of physical form or characteristics, disseminated by an agency to the public.” Sec. 6, k. 
The Appendix to Circular A-130 explains that the language “necessary for the proper performance 
of agency functions” is considered by OMB to be the equivalent of the expression “necessary for the 
transaction of the public business required by law of the agency” in 44 U.S.C. 1108, and that 
agencies must “determine systematically the need for each information dissemination product”. 

These limitation on agency authority to create and disseminate specific information 
dissemination products should be repeated in the OMB guidance, and the guidance should require 
that agencies make, and make available to the public, a specific determination of why the specific 
information dissemination product is needed in order for the agency to carry out a specific statutory 
responsibility, at least with regard to creation of significant new information dissemination products. 
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4. The Need for Coverage of Information Disseminated “For”, Rather Than “By”, 

Federal Agencies 

The PRA, the fundamental statutory authority for the subject OMB guidance, states that one 
of its purposes is to “ensure tire greatest possible public benefit from and maximize the utility of 
information created ... and disseminated by or for the Federal Government. . .(44 U.S.C. § 
3501(2) (emphasis added). A second statement of purpose indicates a similar intent for coverage 
of information dissemination activities conducted “for” Federal agencies, stating a purpose to 
“ensure that the creation . . . [and] dissemination ... of information by or for the Federal 
Government is consistent with applicable laws . . . .” 44 U.S.C. § 3501(8)(emphasis added). The 
legislative history leading up to the Appropriations Act provisions also indicates a Congressional 
intent that the OMB and agency guidance should carry out the position expressed in the PRA that 
the guidance should cover information created and disseminated “for” agencies. 3 This Congessional 
intent was apparently overlooked in Circular A-130, however, since it contains a definition of 
“information dissemination product” that covers only information disseminated “by an agency to 
the public”, and does not refer to information created and disseminated for an agency. 

Agencies should not be able to avoid information quality requirements by contracting with, 
or otherwise establishing a relationship with, a non-governmental entity or another Federal agency 
to develop and disseminate information on their behalf. Congress clearly intended that the purposes 
of the information dissemination quality assurance provisions of the PRA should extend to 
information created and disseminated “for” Federal agencies. On the other hand, the term “for” is 
not further defined or explained in the PRA, and an independent non-governmental entity which 
receives funding from a Federal agency to conduct a study with a great deal of expert independence 
perhaps should not be subject to the OMB and agency data quality guidance because the agency 
would have little control over the quality of the final product. The issue appears to center on the 
extent of actual or potential agency control over the creation of the product and its dissemination. 
If an agency essentially controls how the outside party or agency will create the information product 
and disseminate it, the outside party is certainly acting “for” the agency, almost as if it were its 
agent, and the product and process should be subject to the guidance. This issue should be clarified 
by the OMB guidance. 


3 Congress addressed this issue to a limited extent in the House Report which was a 
precursor to the quality provisions in the Appropriations Act. H.R. Rep. No. 105-592, the precursor 
to the Appropriations Act, directed development of guidance for information “disseminated by 
Federal agencies, and information disseminated by non-Federal entities with financial support from 
the Federal government, in fulfillment of the purposes and provisions of the Paperwork Reduction 
Act of 1995 (P. L. 104-13).” (At 49-50) The report also referred to making the corrective 
mechanism process applicable to “Federal, or Federally-supported, information dissemination”. 
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5. Prior Notice and Consultation for Creation, Modification, or Termination of 

Significant Information Dissemination Products 

The necessity for this prior notice and consultation, and its absence from the proposed 
guidance, is discussed in the cover letter. The PRA requires ‘"adequate notice”. What will constitute 
“adequate notice” and adequate “consultation” should be addressed. The adequacy of notice will 
probably dep end on the nature of the information product. A more specialized product, which would 
likely affect only a limited segment of the public and/or the business community, or which addresses 
a subject about which a relatively limited number of citizens or entities are knowledgeable, will 
probably not require a broad dissemination of notice, and it might be best to simply inform a few 
knowledgeable and interested entities. On the other hand, agencies might want to standardize their 
notice procedures so that they do not have to evaluate the type of notice that should be utilized for 
each new information product. It appears that while considerable discretion might be appropriate 
for agencies on the matter of what constitutes adequate notice, it certainly should be addressed to 
some extent in the OMB guidance. 

The OMB guidance should also note that “consultation” indicates more than a mere 
opportunity to submit a set of written comments. There should be an active two-way exchange of 
views with the key stakeholders with a view to maximizing the quality of the information before it 
is released or changed, or obtaining information on its importance, or lack thereof, before deciding 
to terminate it. 


6. The Agency Information Correction Mechanisms 

Initially, we note that the proposed OMB guidelines only speak of mechanisms for obtaining 
correction of information that does not comply with the QMB guidance. This is too narrow a 
reading of the statutory language. The Appropriations Act requires agency establishment of 
mechanisms to obtain correction of information “that does not comply with the guidelines issued 
under subsection (a)”. Under subsection (b), the guidelines issued under subsection (a) must require 
all Federal agencies to issue conforming guidance. Thus, it seems that clear that Congress intended 
that the corrective mechanisms would apply not only to the OMB guidance, but also to the 
conforming guidance issued by each agency. The interpretation in the proposed OMB guidance - 
that the corrective mechanisms would apply only to the OMB guidance - is not a reasonable 
interpretation to impute to Congress. It would be odd if agencies had to comply with OMB 
guidance, but did not have to comply with their own guidance issued to comply with the OMB 
guidance. It would also not be consistent with the broad purpose stated in the PRA of improving 
Government accountability for the information it disseminates, (Sec, 3501(4).) 


a. Explanation of the Essential Attributes of the Ombudsman Concept 

As discussed briefly in the cover letter comments, the ombudsman concept which has 
become firmly established in the current OMB guidance and which has been incorporated into the 
new proposed guidance is crucial to making the Congressional directives and OMB guidance work 
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in practice and ensuring their credibility, and it should be explained further. While the concept is 
widely recognized internationally, it is not necessarily a familiar concept in the United States, 
particularly within the Federal Government. Therefore, it deserves clarification in the OMB 
guidance. The discussion below amplifies on the listing of essential qualities of ombudsmanship 
set out in the cover letter comments. 4 The listing of essential attributes and the discussion is derived 
from sources such as the ABA recommended standards 5 , the United States Ombudsman Institute 6 , 
the Ombudsman Association 7 , the International Ombudsman Institute 8 , and private sector 
ombudsman offices, such as those maintained by some universities 9 . 

Independence and initiative : It must be made clear that the CIO, when acting as an 
ombudsman under the OMB and agency guidance, does not work on behalf of the agency program 
offices, but is a rigorously independent entity. CIO contact with agency officials and staff following 
receipt of a complaint/request for correction must be only for such purposes as gathering facts 
(investigating) and exploring options for correction, rather than consulting concerning policy views, 
obtaining comments in defense of an agency position, or permitting other agency personnel to 
participate in drafting a response to the complaint. (S)he must be answerable only to the head of 
the agency. This independence must be reflected clearly in the CIO position description; and any 
current position description that does not clearly reflect this attribute must be revised. It is very 
desirable that the CIO/ombudsman be appointed for a fixed term, and be subject to removal only for 
cause, such as clear dereliction in the performance of the ombudsman duties. 


4 Usually confidentiality is listed as one of the essential attributes. This means that the 
ombudsman does not reveal complainants or the allegations they have made. This attribute is 
apparently intended mainly to protect complainants from reprisals in situations where the complaint 
involves an individual and is not a matter of public interest. Such a protection might not be 
appropriate in the subject situation where what is at issue is public information. On the other hand, 
if the complaint is very personal to the complainant, it could be appropriate for the complainant to 
request, and the ombudsman to grant, confidentiality. This issue should be addressed in the final 
guidance. 

3 See the Ombudsman Committee homepage of the ABA’s Section of Administrative Law 
& Regulatory Practice, www.abanet. org/adminlaw/ombuds/home.html, See particularly the 
Standards For The Establishment and Operation of Ombudsman Offices. 

6 See vAvw.usombndsman.org/Rcfcrences/piibiicsectorombudsman.htm. See particularly 
the Model Ombudsman Act for State Governments. 

7 See www.ombuds-toa.org/toa code&std.html . See particularly The Ombudsman 
Association Standards of Practice. 

8 See www.1aw.ualberta.ca/centres/ioi/brochure.htm . 

9 See www.wmich.edu/ombudsman/standards.htm . 
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It must also be made clear that the CIO is free to exercise initiative and broad discretion in 
investigating complaints and considering remedies, and is not bound by specific allegations or 
suggestions made in the request for a correction. This discretion and initiative extends to being able 
to interview agency individuals and outside consultants and obtain documentary materials. 

Impartiality : The ombudsman is a neutral mediator. (S)he is not an advocate for either side 
of a dispute. (S)he should also not be viewed as a political appointee. This also means, that, unlike 
a judicial body, the ombudsman does not accord “deference” to the agency (such as under Chevron 
or Mead) when considering any aspect of a petition for correction. 

Appropriate expertise and personal qualities : Many of the CIO duties under the PRA and 
Circular A-130 pertain to the maintenance of technical information systems, rather than the 
evaluation of the quality of information disseminated to the public. In order to handle properly 
quality complaints, the CIO, or perhaps the Deputy CIO, must be an individual who has experience 
with the types of issues likely to arise within the particular agency. For example, the CIO in a health 
or environment agency should have substantial training and experience for scientific issues involving 
public health and/or ecology. 

The CIO who acts as an ombudsman must also have strong personal qualities for carrying 
out the assigned duties and establishing respect and credibility for the office. Ideally, such a person 
should already have achieved a reputation for rigorous independence, impartiality, initiative, and 
problem solving. 

Sufficient resources and powers : The agency head must ensure that the CIO is given 
sufficient staff and other resources to implement the guidance with thoroughness and 
expeditiousness. Dissemination of inaccurate information is capable of causing great harm, and if 
a petition for correction is not acted upon thoroughly and expeditiously that harm will continue. 
OMB and the agencies should consider giving the ClO/ombudsman the power to have the agency 
withdraw an information dissemination product if, in the CIO’s judgment, thepetition for correction 
makes out a strong case and it appears that resolution of the complaint might take substantial time 
during which significant harm could result from continuing dissemination of an information product. 


b. Agency responsiveness to ombudsman recommendations 

Ordinarily, an ombudsman does not have power to bind, but only to make findings and 
recommendations. Nevertheless, the agency should have an obligation to respond expeditiously to 
those findings and recommendations, and if it will not follow them in whole or in part, to provide 
a reasoned justification for not doing so. Both the ombudsman’s findings and recommendations and 
the agency’s response should be provided promptly to the petitioner(s). Responses of both the 
ombudsman and the agency should address fairly all of the principal points raised by a petitioner. 
If the agency accepts the findings and recommendations in whole or in part, the response should 
indicate what action will be taken and when, and action should be taken as quickly as possible. 
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7. Issuance of the Agencies’ Conforming Guidance and OMB Review 

It is clear from the statutory directives (e.g., 44 U.S.C. § 3506(a)(1)(B)) that the agencies’ 
guidelines must conform to the OMB guidelines, while also being tailored to the individual agencies’ 
programs and structures. Yet the proposed OMB guidance does not state this under Section II, 
“Agency Responsibilities”. The section on Agency Responsibilities must reflect the statutory 
directives. 

The statement in Section III that agencies “should” adopt a high standard of quality as a 
“goal” is not appropriate. Pursuant to the statutory directives, the agencies “must” disseminate only 
information that meets the standards of quality, objectivity, utility, and integrity; it is not a “goal” 
to be worked towards in some indeterminate future. 

As discussed in the cover letter comments, the OMB guidance should require that the 
agencies issue proposed guidelines with an opportunity for public comment. We also recommend 
that the OMB guidance provide the OMB will review both the proposed and final agency guidance, 
and that the draft final guidance sent to OMB for review must be accompanied by a reasonably 
complete response to the public comments. 


8. Definition of the terms “quality, objectivity, utility, and integrity” 

We generally agree that the term “quality” was intended to encompass the other three terms, 
while then focusing attention on specific aspects of quality through the additional three terms. We 
recommend a few additions to the proposed definitions. 

With regard to quality generally, we recommend that the definition require that information 
be soundly based. This requirement is captured in part by the statement that “the presentation [of 
information] should clearly reflect the quality of the information” (a very important statement); 
however, that statement could be interpreted as a license to disseminate low-quality information so 
long as the low quality is reflected in the presentation. (This is also an example of a statement where 
the OMB guidance should use the terms “shall” or “must” rather than “should”.) 

We recommend adding that the information must be substantially up-to-date, as an aspect 
of being “complete”. 

Finally, we recommend that, as an aspect of “integrity”, the information must be consistent 
and coherent, both internally, and externally with other information dissemination products of the 
agency and other agencies. 
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9. Statistical and Mathematical Models 

OMB is correct in stressing the importance of reproducibility and transparency of 
government information, key components in evaluating the quality of such data. However, OMB 
should explicitly address and include certain types of information which may be utilized by agencies 
in standard setting and other activities. Specifically, we refer to statistical and mathematical models, 
code, and test raethods/mstructions used to generate values which have regulatory effect. 

Such models are often the real drivers of agency regulations and policy. Consequently, the 
details of the model should be made available to the public, so that interested parties may understand 
how regulators reached their decision and may seek to reproduce and validate an agency’s results. 
Where errors in such models are found, the correction mechanism in the OMB guidelines should be 
available for their resolution. This practice furthers multiple objectives, including transparency, 
accountability, and information quality. 

OMB should also state clearly that subsequent modifications to these models should be open 
to the public and subject to the Data Quality guidelines, as such modifications could impact overall 
operation of such models and their results. 


10. Annual Agency Report 

The proposed guidance appears unclear in Section IV on whether the CIO must prepare and 
submit the annual report. On the one hand, it refers to the requirement in Circular A-13G that the 
CIO must prepare and submit tire annual report; on the other hand the same section states that the 
“agency” must submit the report. We recommend that the OMB guidance require that the CIO, 
acting as an ombudsman, at least concur in the annual report, and that both the agency and the CIO 10 
should include in the report any recommendations for improving either the OMB or the agency 
guidance and practice. 


10 The power and responsibility to make recommendations for improvements in institutional 
practices related to his/her duties is ordinarily considered one of the important attributes of an 
ombudsman. 


-9- 


PM3001117886 


Source: https://www.industrydocuments.ucsf.edu/docs/yxxk0001 



